Emergent Quantized Communication

نویسندگان

چکیده

The field of emergent communication aims to understand the characteristics as it emerges from artificial agents solving tasks that require information exchange. Communication with discrete messages is considered a desired characteristic, for scientific and applied reasons. However, training multi-agent system not straightforward, requiring either reinforcement learning algorithms or relaxing discreteness requirement via continuous approximation such Gumbel-softmax. Both these solutions result in poor performance compared fully communication. In this work, we propose an alternative approach achieve -- quantization communicated message. Using message allows us train model end-to-end, achieving superior multiple setups. Moreover, natural framework runs gamut Thus, sets ground broader view deep era.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Emergent Gravity from Quantized Spacetime

We examine the picture of emergent gravity arising from a mass deformed matrix model. Due to the mass deformation, a vacuum geometry turns out to be a constant curvature spacetime such as d-dimensional sphere and (anti-)de Sitter spaces. We show that the mass deformed matrix model giving rise to the constant curvature spacetime can be derived from the d-dimensional Snyder algebra. The emergent ...

متن کامل

Emergent Communication through Negotiation

Multi-agent reinforcement learning offers a way to study how communication could emerge in communities of agents needing to solve specific problems. In this paper, we study the emergence of communication in the negotiation environment, a semi-cooperative model of agent interaction. We introduce two communication protocols – one grounded in the semantics of the game, and one which is a priori un...

متن کامل

Average consensus on networks with quantized communication

This work presents a contribution to the solution of the average agreement problem on a network with quantized links. Starting from the well-known linear diffusion algorithm, we propose a simple and effective adaptation which is able to preserve the average of states and to drive the system near to the consensus value, when a uniform quantization is applied to communication between agents. The ...

متن کامل

On Multi-Vehicle Rendezvous Under Quantized Communication

A rendezvous problem for a team of autonomous vehicles, which communicate over quantized channels, is analyzed. The paper illustrates how communication topologies based on uniform and logarithmic quantizations influence the performance. Since a logarithmic quantizer in general imposes fewer bits to be communicated compared to a uniform quantizer, the results indicate estimates of lower limits o...

متن کامل

Quantized Stochastic Gradient Descent: Communication versus Convergence

Parallel implementations of stochastic gradient descent (SGD) have received signif1 icant research attention, thanks to excellent scalability properties of this algorithm, 2 and to its efficiency in the context of training deep neural networks. A fundamental 3 barrier for parallelizing large-scale SGD is the fact that the cost of communicat4 ing the gradient updates between nodes can be very la...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i10.26363